Data Warehousing and Hadoop: A Critical Examination With Connections to Bioinformatics
نویسنده
چکیده
The Data Warehousing field has been fundamentally changed by the Big Data revolution. Computational and storage methodologies such as Hadoop provide an alternate way of managing and analyzing the torrent of data that is flooding in from all manner of instrumentation. This review article will elucidate the relationship between traditional enterprise data warehousing and one of the primary analytics technologies developed in the last decade, Hadoop through the lens of bioinformatics and genomics principles. Keywords— Data Warehousing, Star Schema, ETL, Hadoop, MapReduce, Bioinformatics, Genomics
منابع مشابه
Adaptive Dynamic Data Placement Algorithm for Hadoop in Heterogeneous Environments
Hadoop MapReduce framework is an important distributed processing model for large-scale data intensive applications. The current Hadoop and the existing Hadoop distributed file system’s rack-aware data placement strategy in MapReduce in the homogeneous Hadoop cluster assume that each node in a cluster has the same computing capacity and a same workload is assigned to each node. Default Hadoop d...
متن کاملResearch in Big Data Warehousing using Hadoop
Traditional data warehouses have played a key role in decision support system until the recent past. However, the rapid growing of the data generation by the current applications requires new data warehousing systems: volume and format of collected datasets, data source variety, integration of unstructured data and powerful analytical processing. In the age of the Big Data, it is important to f...
متن کاملBioPig: a Hadoop-based analytic toolkit for large-scale sequence data
MOTIVATION The recent revolution in sequencing technologies has led to an exponential growth of sequence data. As a result, most of the current bioinformatics tools become obsolete as they fail to scale with data. To tackle this 'data deluge', here we introduce the BioPig sequence analysis toolkit as one of the solutions that scale to data and computation. RESULTS We built BioPig on the Apach...
متن کاملHadoop-GIS: A High Performance Spatial Data Warehousing System over MapReduce
Support of high performance queries on large volumes of spatial data becomes increasingly important in many application domains, including geospatial problems in numerous fields, location based services, and emerging scientific applications that are increasingly data- and compute-intensive. The emergence of massive scale spatial data is due to the proliferation of cost effective and ubiquitous ...
متن کاملHadoop-BAM: directly manipulating next generation sequencing data in the cloud
Hadoop-BAM is a novel library for the scalable manipulation of aligned next-generation sequencing data in the Hadoop distributed computing framework. It acts as an integration layer between analysis applications and BAM files that are processed using Hadoop. Hadoop-BAM solves the issues related to BAM data access by presenting a convenient API for implementing map and reduce functions that can ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2016